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ABSTRACT 

Me  prove  that  the  upper  and  lower  values  defined  by  Elliot-Kalton  [9]  for 
a  two-person,  zero-sum  differential  game  are  the  viscosity  solutions  of  the 
upper  and  lower  Isaacs  equations,  respectively.  As  an  application  we  obtain 
fairly  simple  representation  formulas  for  the  viscosity  solutions  of  certain 
Hami 1 ton- Jacobi  pde.  We  also  employ  these  formulas  to  study  a  problem  from 
geometric  optics. 
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SIGNIFICANCE  AND  EXPLANATION 


Recent  work  by  the  authors  and  others  has  demonstrated  the  connections 


between  the  dynamic  programming  approach  for  two-person,  zero-sum  differential 


gomes  and  the  new  notion  o 


fN*Viscosity’,^so 


solutions  of  Hami lton-Jacobi  PDF, 


introduced  by  M.  G.  Crandall  and  P.  L.  Lions*  The  basic  idea  is  that  the 
dynamic  programming  optimality  conditions  imply  that  the  ^values"  of  a  two- 
person,  zero-sum  differential  gome  are  viscosity  solutions  of  appropriate 
PDE.  This  paper  proves  the  above,  when  the  values  of  the  differential  games 
are  defined  following  Elliott-Kalton.  This  results  in  a  great  simplification 
in  the  statements  and  proofs,  as  the  definitions  are  explicit  and  do  not 
entail  any  kind  of  approximations.  Moreover,  as  an  application  of  the  above 
results,  the  paper  contains  a  representation  formula  for  the  solution  of  a 
fully  nonlinear  first-order  PDE.  This  is  then  used  to  prove  results  about  the 
level  sets  of  solutions  of  Hami lton-Jacobi  equations  with  homogeneous 
Hamiltonians.  These  results  are  also  related  to  the  theory  of  Huygen's 
principle  and  geometric  optics. 


The  responsibility  for  the  wording  and  views  expressed  in  this  descriptive 
summary  lies  with  MRC,  and  not  with  the  authors  of  this  report. 


DIFFERENTIAL  GAMES  AND  REPRESENTATION  FORMULAS  FOR 
SOLUTIONS  OF  HAMILTON- JACOB I- ISAACS  EQUATIONS 

1  2 
L.  C.  Evans  and  P.  E.  Souganidis 

1.  Introduction 

Recent  work  by  the  authors  and  others  has  demonstrated 
the  connections  between  the  dynamic  programming  approach  to 
two-person,  zero-sum  differential  games  and  the  new  notion  of 
"viscosity"  solutions  of  Hamilton-Jacobi  PDE,  introduced  in 
Crandall-Lions  [83.  The  formal  relationships  here  were  ob¬ 
served  by  Isaacs  in  the  early  1950's  (cf.  [183) r  he  showed 
that  if  the  values  of  various  differential  games  are  regular 
enough,  then  they  solve  certain  first  order  PDE  with  "max-min" 
or  "min-max"  type  nonlinearity  (the  Isaacs  equations) .  The 
problem  here  is  that  usually  the  value  functions  are  not 
sufficiently  smooth  to  make  sense  of  these  PDE  in  any  obvious 
way.  Many  later  papers  in  the  subiect  have  worked  around 
this  difficulty:  see  especially  Fleming  [13],  [14],  Friedman 
[15],  [16],  Elliott-Kalton  [9]-[ll],  Krassovski-Subbot in  [20], 
Subbotin  [26],  etc,,  etc.  and  the  references  therein. 

Recently,  however,  M.  Crandall  and  P.L.  Lions  [8]  have 
discovered  a  new  notion  of  weak  or  so-called  "viscosity" 
solution  for  Hamilton-Jacobi  equations,  and,  most  importantly, 
have  proved  uniqueness  of  such  a  solution  in  a  wide  variety  of 
circumstances.  This  concept  was  reconsidered  and  simplified 
in  part  by  Crandall,  Evans,  Lions  [7],  whose  approach  we  follow 
below.  Additionally,  Lions  in  his  new  book  [21]  has  made  the 
fundamental  observation  that  the  dynamic  programming  optimal  ity 

^Department  of  Mathematics,  University  of  Maryland,  College 
Park,  MD  20742.  Supported  in  part  by  National  Science 
Foundation  Grant  MCS-81-02846  and  the  Alfred  P.  Sloan  Foundation. 
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condition  for  the  value  in  differential  control  theory  problems 
implies  that  this  value  function  is  the  viscosity  solution  of 
the  associated  Hamilton-Jacobi-Bellman  PDE:  see  [21,  p.  53-54] 
for  more  explanation.  Some  related  papers  are  Lions  [23] , 
Lions-Nisio  [24],  Capuzzo  Dolcetta-Evans  [5],  Barles  [2], 
Capuzzo  Dolcetta  [4],  Capuzzo  Dolcetta-Ishii  [6],  etc. 

The  foregoing  considerations  turn  out  to  extend  to  dif¬ 
ferential  game  theory,  where  additional  complications  arise  even 
as  to  the  definition  of  the  value  functions.  Nevertheless 
the  basic  idea  is  still  valid,  that  the  dynamic  programming 
optimality  conditions  imply  that  the  values  are  viscosity 
solutions  of  appropriate  PDE.  See  Sou^enidis  [27]  for  a  demon¬ 
stration  of  this  based  on  both  the  Fleming  and  the  Friedman 
definitions  of  upper  and  lower  values  for  a  differential  game, 
and  Barron- Evans- Jensen  [3]  for  a  different  proof  for  the 
Friedman  definition.  Some  similar  results  are  to  be  found  in 
P.L.  Lions  [22]. 

The  present  paper  represents  a  simplication  of  this  pre¬ 
vious  work.  The  new  approach  here  is  to  define  the  values  of 
the  differential  game  following  Elliott-Kalton  [9]-[ll]  (cf. 
Roxin  [25])  rather  than  Fleming  or  Friedman.  This  results  in 
a  great  simplification  in  the  statements  and  proofs,  as  the 
definitions  are  explicit  and  do  not  entail  any  kind  of 
approximations . 

The  appropriate  terminology  is  introduced  in  §2.  In  53 
we  reproduce  (and  simplify  a  bit)  Elliott  and  Kalton's  proof 
of  the  optimality  conditions  and  of  the  Lipschitz  continuity  of 
the  upper  and  lower  value  functions.  Then  in  54  we  prove 
that  the  value  functions  are  the  (unique)  viscosity  solutions 
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of  the  appropriate  Isaacs  equations;  our  demonstration  of 
this  owes  a  lot  to  previous  papers  (especially  [31  and  [27]), 
but  is  essentially  simpler  in  many  ways. 

The  remainder  of  the  paper  is  devoted  to  some  applications. 
First,  in  §5  we  discuss* (cf.  Fleming  [14])  how  to  write  a 
fairly  arbitrary  Hamilton-Jacobi  equation  as  the  upper  Isaacs 
equation  for  some  differential  game,  so  that  the  viscosity 
solution  is  this  upper  value.  The  consequence  is  a  kind 
of  representation  formula  for  the  solution  of  the  origin¬ 
al,  fully  nonlinear  first-order  PDE.  We  thereafter  in  §7 
employ  this  representation  formula  to  prove  results  about  the 
level  sets  of  solutions  to  Hamilton-Jacobi  equations  with 
homogeneous  Hamiltonians;  these  questions  we  motivate  in  §6 
with  a  discussion  of  geometric  optics  and  Huygen's  principle. 

Part  of  the  point  of  this  application  is  to  show  that  the 
game  theory  methods  provide  mathematically  rigorous  and  rela¬ 
tively  simple  procedures  for  justifying  various  formal  calcula¬ 
tions  concerning  Hamilton-Jacobi  equations.  Roughly  speaking, 
the  trajectories  for  the  differential  game  serve  as  "generalized 
characteristics"  existing  in  the  large. 

We  should  note  also  that  our  hypotheses  throughout  are 
almost  always  stronger  than  is  really  necessary,  since  we  wish 
to  display  the  methods  in  the  clearest  setting.  The  interested 
reader  should  consult  Ishii  [19]  for  some  extensions  of  our 
results  to  differential  game  problems  under  much  weaker  hypothese 

We  conclude  by  recording  here  the  relevant  definition 
of  viscosity  solutions,  from  [7],  [8],  [3]. 
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Assume  H:  [0,Tj  x  3Rm  *  3Rm  ■*  3R  is  continuous,  and 
g:  3Rm-*>]Rm  is  bounded,  uniformly  continuous.  A  bounded, 
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uniformly  continuous  function  u:  [0,T3  x  3Rm+  ]Rm  is 
called  a  viscosity  solution  of  the  Hamilton-Jacobi  equation 


u^  +  H(t,x,Du)  =  0 

u(T,x)  =  g(x) 


in  (0  ,T)  x  TRm 

in  3Rm 


provided  (1.2)  holds  and  for  each  $  €  C1((0,T)  x  lRm  ) 
(a)  if  u-4  attains  a  local  maximum  at 
(tg ,Xg)  €  (0,T)  x  TRm  ,  then 


(1.3) 


♦t(tg,Xg)  ♦  H(tg,Xg,D^(tg,Xg))  >  0, 


and 

(b)  if  u-4  attains  a  local  minimum  at 
(to,x0)  «  (0,T)  x  ®m  ,  then 

(1.4)  ♦t(tg,Xg)  ♦  H(tg,Xg,D^(tg,Xg))  <  0. 

See  [7],  [8]  for  a  proof  that  if  u  is  a  viscosity  solution  of 
(HJ)  and  if  u  is  differentiable  at  some  point  (tg,Xg), 
then 

Utttg.Xg)  +  H( tg ,Xg ,Du( t g ,Xg ) )  =  0. 
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a 


Remark .  We  have  described  here  the  appropriate  4  ••  L-ilt  Ion  for 
the  terminal  value  problem  (1.1),  (1.2);  this  is,  as  we  shall 
see,  the  kind  of  PDE  arising  in  game  theory  applications.  A 
viscosity  solution  of  the  initial  value  problem  (1.1), 

(1.2)’  u(x,0)  =  g(x)  in  ]Rm , 

is  defined  by  reversing  the  inequalities  in  (1.3),  (1.4). 


o 


r 


2.  Terminology 

We  mostly  adopt  here  the  notation  of  Elliott-Kalton  T9] 
(a)  Definition  of  the  differential  game 


Fix  T>t?0,  x  €  ]Rm  and  consider  the  differential 
equation 


(ODE) 


x(s)  =  f (x,x(s) ,y(s)  ,z(s)) 


x(t) 


t  <  s  <  T 


Here 


y:  Ct,T] 


and 


z:  ft ,T]  -  Z 


are  given  measurable  functions  (called  the  controls  employed 

k  t 

by  players  I  and  II,  respectively)  and  Y  c  ]R  ,  Z  c  ]R 
are  given  compact  sets.  We  assume 


f:  [0,T]  X  3Rm  X  Y  X  z  -  3Rm 


is  uniform!.,  continuous,  with 

r 

| f (t ,x,y  ,z) |  <  Cx 


(2.1) 


f (t ,x,y,z)  -  f (t ,x,y,z) 


C^lx-xl 


for  some  constant  and  all  0<t5T,  x,x€lRm  , 


y(Y,  z*Z. 


The  (unique)  solution  x(*)  of  (ODE)  is  the  response  of  the 
system  to  the  controls  y(«),  *(•). 

Associated  with  (ODE)  is  the  payoff  functional 


(P)  P(y,z)  * 


pt,x(y(' 


),z(0)«  j  h(s,x(s),y(s),z(s))ds  ♦  g(x(T))» 


where  g:  ]Rm  -*•  1R  satisfies 


(2.2) 


1|g(x)J  <  C2 

I g(x)  -  g(x) ]  <  C2|x-x|  , 


and  h:  [0,T3  *  IR®  x  YxZ  ■»  1R  is  uniformly  continuous,  with 


(2.3) 


f|h(t,x,y,z)|  S  C3 


A  A 

|h(t,x,y,z)  -  h(t,x,y,z)|  s  C3|x-x| 


for  constants  C2,C3  an^  x,x€3R®,  y*Y,  z€Z. 
of  player  I  is  to  maximize  P  and  the  goal  of  player 
minimize  P. 


The  goal 
II  is  to 


(b)  The  upper  and  lower  values 
Set 

M(t)  ■  {  y:  [t,T3  ♦  Y|  y  measurable} 
N(t)  •  ( c:  Ct,T)  •+  Z|  z  measurable}  ; 


these  are  the  sets  of  all  controls  for  I  and  II,  respectively. 
We  will  henceforth  identify  any  two  controls  which  agree  a.e. 


Following  now  Varaiva  [29],  Roxin  C 2 5 D  and  Elliott-Kalton  [9] 


we  define  any  mapping 


o:  N(t)  -*■  M(t> 


to  be  a  strategy  for  I  (beginning  at  time  t)  provided  for  each 
tissT  and  z,z€N(t): 


(2.4) 


z(t) 


Z(t)  for  a.e.  t  £  x  £  s 


implies  a[z](x)  =  a[z](x)  for  a.e.  t  £  x  <  s 


Similarly  a  mapping 


0:  M(t )  -•»  N(t) 


is  a  strategy  for  II  (beginning  at  time  t)  provided  for  each 
t£s£T  and  y,y€M(t): 


(2.5) 


y(x)  =  y(x)  for  a.e.  t  £  x  £  s 


implies  0[y](x)  =  p[y](x)  for  a.e.  t  £  x  ■?  s  . 


Denote  by  T(t)  the  set  of  all  strategies  for  I  and  by  A(t) 
the  set  of  all  strategies  for  II,  beginning  at  time  t. 

Finally  define 


(2.6) 


V(t,x)  a  inf  sup  P(y,  pCyl) 
p€A(t)  y€M(t) 


=  inf  sup  (I  h(s,x(s) ,y(s) ,SCy](s))ds  ♦  g(x(T))} 
p«A(t)  y€M(t)  > 


x(*)  solving  (ODE)  for  y(-)  and  z(*)  =  pty](*). 


Analogously  set 


r 

UCt,x)  *  sup  inf  P(a[z],  z) 
a€r(t)  z€N(t) 

<2'7)  \  ,T 

[  s  sup  inf  {  h(s,x(s),aCz](s),z(s))ds  +  gCx(T))}  , 

I  a*r(t)  z€N(t) 

x(*)  solving  (ODE)  with  z(-)  and  y(*)  *  a[z3(*). 

We  call  V  the  lower  value  and  U  the  upper  value  of  the 
differential  game  (ODE),'  (P).  Our  goal  is  to  show  that  V  and 
U  solve  certain  nonlinear  PDE  (in  the  viscosity  sense). 


3.  Properties  of  the  upper  and  lower  values 

The  results  in  this  section  are  proved  in  Elliott-Kalton  TlO]. 
We  reproduce  and  simplify  slightly  their  arguments  for  the  read¬ 
er's  convenience. 

Theorem  3.1  For  each  0<tct+csT  and  x€lRm 

ft+a 

C3.1)  V(t,x)  =  inf  sup  {  h(s,x(s),y(s),6ty](s))ds  +  V(t+a,x(t+cO) }  , 

P€A(t)  y€M(t) 

and 

ft+a 

(3.2)  U(t,x)  =  sup  inf  {I  h(s,x(s) ,a[z](s) ,z(s))ds  +  U(t+cr,x(t+c'))}  . 

a€r<t)  z€N(t)  Jfc 

These  are  the  dynamic  programming  optimality  conditions . 

Remark.  In  (3.1)  and  (3.2),  as  elsewhere  below,  we  implicitly 
mean  x(*)  to  solve  (ODE)  with  the  appropriate  controls  y(0 
and  *  z ( • ) . 

Proof.  We  prove  (3.1)  only,  as  the  proof  of  (3.2)  is  similar. 

Set 

t+.a 

(3.3)  W(t,x)  *  inf  sup  (I  h(s,x(s) ,y(s) ,BCy](s))ds  +  V(t+o,x(t+cO)} 

P€A(t)  y€M(t) 

and  fix  e>0.  Then  there  exists  5€A(t)  such  that 

rt+O 

(3.4)  W(t,x)  >  sup  (  h(s,x(s),y(s),6[y](s))ds  +  V(t+o,x(t+o))}  -  e  . 

y(M(t) 
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e  . 


T 


(3.7) 


fT 


V(t,x)  >  sup  {I  h(s,x(s) ,y(s),6[y](s))ds  +  g(x(T))}  - 
y€M(t)  ' 


Thus 


rt+a 

W(t,x)  <  sup  {  h(s,x(s),y(s),6[y](s))ds  +  V(t+a,x(t+o))l  , 

y€M(t) 


and  consequently  there  exists  y^fhKt)  such  that 


rt+a 

(3.8)  W(t,x)  <  j  h(s,x(s),y1(s),8Cy13(s))ds  +  V(t+a,x(t+er))  +  e 


Now  for  each  y€M(t+a)  define  y€M(t)  by 


y(s)  « 


y^s) 


y(s) 


t  <  S  <  t+O 


t+a  5  s  5  T 


and  then  define  ^€A(t+c)  by 


£lyj(sl  *  p[y]  (s)  (t+a  s  s  s  T) 


Now 


fT 

V(t+o  ,x(t+ a) )  <  sup  (  h(s,x(s) ,y(s) ,8[y](s))ds  +  g(x(T))} 
y€M(t+  a) 

and  so  there  exists  y2€M(t+o)  for  which 


fT 

(3.9)  V(t+o,x(t+o) )  <  I  h(s,x(s),y2(s),|Cy23(s)ds  +  p,(x(T)) 

t+a 


+  r 


-12- 


■  V: 


Define  y«M(t)  by 


(y^s)  t  s  s  <  t+o 

y2<8)  t+o  <  s  <  T  . 

Then  (3.8)  and  (3.9)  yield 

fT 

(3.10)  W(t,x)  s  j  h(s,x(s) ,y(s) ,6[y](s))ds  +  g(x(T))  +  2e  , 

t 

and  so  (3.7)  implies 

W(t ,x)  S  V (t ,x)  +  3e  . 

This  and  (3.6)  complete  the  proof. 

o 

Next  we  examine  the  boundedness  and  continuity  of  the 
value  functions: 

Theorem  3 . 2  There  exists  a  constant  C4  such  that 

(3.11)  | V(t,x) | ,  |U(t ,x) (  5  C4 

(3.12)  |V(t,x)  -  V(t,x)|,  ju(t,x)  -  U(t,x)|  <  C4(|t-f|  +  |x-x|) 

for  all  Oit ,tsT,  x,x€®ra. 

Proof 

We  give  the  proof  for  U  only  since  similar  arguments  work 
for  V. 

-13- 
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First,  owing  to  (2.2)  and  (2.3)  we  have 


) P(y,z) |  £  TC3  +  C2 

for  all  y( • )fM(t) ,z( • )€N(t) .  This  at  once  implies  estimate 
(3.11)  for  V. 

To  prove  (3.12)  for  V  let  us  first  choose  x^,x2€2Rn, 
0£t^£t2sT.  Pick  e>0  and  then  select  a€r(tj)  so  that 

(3.13)  U(t,,x-.)  £  inf  P(ot[z],z)  +e 

1  z(N(tx) 


Now  define  a€T(t2)  by  setting  for  each  z€N(t2> 

a[z]  «  a[z]  (t9  £  s  £  T)  . 


Finally  select  z(N(t2)  so  that 

(3.14)  U(t2,x2)  >  P(a[z],z)  -  e  . 


According  to  (3.13) 


(3.15)  U(t1,x1)  5  P(a[z],z)  +  t  . 

Now  let  x1(*)  solve 


r 


dx, (s) 

— —  =  f(s,x  (s) ,a[z](s) ,z(s) )  (tx  <  s  <  T) 


xi(ti) 


and  let  x2<*)  solve 


dx2(s) 
ds 


f(s,x(s),  a[z](s) ,z(s) )  (t?  <  s  <  T) 


x2(t2) 


* 


We  have 

|x-^(t2)  —  xj  ~  ~  ^2 1  • 

Furthermore,  since  z=z  and  £,Cz]  =  a[z]  on  (t2,T), 

(3.16)  Ix^s)  -  x2(s)|  <C|x1(t2)  -x2|  «  C(  |t-L-t?  |  +  |x1-x2|)  (t?<s<T) 


Thus  (3.14)  and  (3.15)  imply 
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U(t^,x^)  -  U(t2,x2)  s  P(a[z],z) 


f  2 

a  I  hCsyX^Cs)  ,a[z](s)  ,z(s)  )ds 


P(aCz],z)  +  2 i 


{T 

(3.17)  +  J  [h(s,x. (s) ,a[z](s) ,z(s) )  -  h(s,x2  (s) ,a[z](s) ,z(s) )Ids 
fc2 

♦  g(x1(T))  -  g(x2<T))  +  2c 


<  C<  | |  ♦  |xx-x 2|)  +  2c  , 

by  (2.1)-(2.3)  and  (3.16). 

On  the  other  hand  let  us  select  a€T(t2)  such  that 

(3.18)  U(t,,x0)  5  inf  P(a[z],z)  +  e  . 

2  2  z(N(t2) 

For  each  z€N(t1)  define  z€N(t2)  by 


z(s)  = 

z(s) 

(t2  < 

S  £• 

T)  . 

Fix  any  yQ€Y  and  then 

define 

a€T(t1) 

by 

a[z] 

f 

*1  5 

S  5 

t2 

Ia[z3 

t2  5 

S  2 

T  . 

Now  choose  z€N(t1)  so  that 

(3.19)  U(t1,x1)  >  P(a[z],z)  -  e 
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iV-  "•*  "w 


According  to  (3.18) 


(3.20) 


U(t2>x2)  -  P(a[z],z)  +  e  . 


Let  x1(*)  solve 


dx^(s) 

di 

xi(ti) 


f(s,x^(s),a[z](s),z(s))  (t^  <  s  <  T) 


and  let  Xj(’)  solve 


f 


dx2(s) 

ds 


f (s  ,x2(s) ,a[z](s) ,z(s) )  (t2  <  s 


T) 


x2 ( 1 2 )  =  x2 


As  above  Ix-^t^-xJ  s  c1|t1-t2|  ;  and  since  z 


a[z]  =  a[z]  on  (t~,T), 


(3.21)  |x1(s)-x2(s)|f  C|x1(t2)-xJ  C(  {t1-t2 1  +  I x]_“x2 1  >  (t? 


T) 


Therefore  (3.18)  and  (3.20)  imply 


-17- 


r* 


U(t2,x2)  -  U(t1,x1>  5  P(«C^3»2)  -  P(a[z],z)  ♦  2e 
1 12 

*  -I  Ms.x^s)  ,a[z](s)  ,z(s))ds 
tl 

T 

♦  |  [h(s,x2(s) ,atz](s) ,z(s) )  -  h(s,x^(s) ,a[z](s) »z(s)  )]ds 

t2 

*  g(Xj(T))  -  g(x1(T))  ♦  2e 

<  C<  |  t1-t2 1  ♦  Ix^x^l)  +  2e  , 


by  (2.1)-(2 . 3)  and  (3.21). 

This  and  (3.17)  prove  estimate  (3.12)  for  U. 


Corollary  4.2  (i) 

(ii) 

H+(t,x,p) 


V  <  U  (0«t?T,  x€lRm) 

If  for  all  0  <  t  <  T,  x,p  €  R1" 

=  H~(t,x,p)  ,  (minimax  condition 


then 


U  «  V 


The  Corollary  follows  from  the  standard  comparison  and  uniqueness 
theorems  for  viscosity  solutions:  see  [7],  [8],  [21],  [27]. 

Proof  of  Theorem  4 .1 

We  prove  assertion  (a)  only. 

Let  $  (  C1((0,T)  *  3Rm  )  and  suppose  U  attains  a 

local  maximum  at  (t0,xQ)  t  (0,T)  *  .  We  must  prove 

(4.1)  ♦t(t0*X0)  +  ^  ^0,x0*^^0'x0^  ^  ®  * 

Should  this  fail,  there  would  exist  some  8>0  so  that 

(4.2)  ^(tgjXg)  +  H+(tg  ,XQ,D$(tg  ,Xg)  )  5  -6  <  0. 


According  to  Lemma  4.3  (a)  (stated  and  proved  below)  this  im¬ 
plies  that  for  each  sufficiently  small  a>0  and  all  a€r(tQ) 


(4.3) 


+a 

(h(s,x(s),a[z](s),z(s>)  +  f(s..x(s),a[z](s),z(s))  •  DK5,x(s)) 


♦  $  (s,x(s))Jds  s 


for  some  z(N(tQ).  Thus 


,v° 


(4.4)  sup  inf  {  I  (h(s,x(s) ,o[z](s),z(s)) 
a€T(t«)  z€N(tQ)  J 
^0 


+  f(s,x(s),a[z](s),z(s))*DKs,x(s))  +  4>t(s,x(s))  ]  ds }  s  ~  2- 


However  Theorem  3.1  states 


fV° 

(4.5)  U(tn,xn)  =  sup  inf  {  |  h(s,x(s),a[z](s),z(s))d s 

U  U  a€r(t0)  z€N(tQ)  J 

t0 

.  +  U(tQ+CT,  x(tQ+o)))  . 


Since  U-$  has  a  local  maximum  at  (tg,Xg),  we  have  for  a 
small  enough  that 

(4.6)  U(tn,xn)  -  *(tn,xn)  >  U(tn+e,  x(tn+a))  -  $(tn+cr,  x(tn+c0) 


where  x(*)  solves  (ODE)  on  (tg.tg+o)  for  any  y(-),  z(*), 
with  the  initial  condition  x(tg)  =  xQ.  Now  (4.5)  and  (4.6)  pive 

,  V  ° 

(4.7)  sup  inf  {]  h(s,x(s),a[z](s),z(s))ds  +  <Ktn+cr,  x(tn+o)) 

a€r(t0)  zMtJ  {  0  0 

-  ♦(tg,Xg))  £  0  . 


rV* 


(4.8)  $(t(j+a,X(tQ+<7))  -  ^(tg,Xg))  =  j  (f(s,X(s),nrz](s),7.(s))‘lXs,x(:;)) 


+  ♦t(srx(s) ) ]ds  ; 
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«nd  so  (4.7)  contradicts  (4.4).  Thus  (4.1)  must  in  fact  be  valid. 

Naxt,  suppose  U-$  has  a  local  minimum  at  (tQ,XQ>€(0,T)*IRm. 
We  Bust  demonstrate 

(4.9)  t.g(tgyXg)  ♦  H  ( t  Q  y  X  q  f D$  ( t  q  y  X  0 )  )  5  0 
and  so  will  assume  to  the  contrary  that 

(4.10)  #t(t0>x0)  +  H+(t0,XQ,D^(tg,XQ))  >  e  >  0 

for  some  constant  0>O.  Then  Lemma  4.3(b)  asserts  that  there 
exists  for  all  sufficiently  small  a> 0  some  aer(tg)  such  that 

t„+o 

(4.11) 

for  all 

(4.12) 

But  since  U-$  has  a  local  minimum  at  (tg,Xg),  we  have  for 
small  enough  o>0  that 

U  ( tg  f  XQ )  -  ♦(tgyXg)  S  U ( t Q+ C , X ( t q  + O ) )  -  ♦ ( t g+ O , X ( t g  +  O )  )  , 

x( * )  solving  (ODE)  on  (tg.tg+o)  for  any  y(*),  z(*),  with  the 


J  fh(s,x(s),a[z](s),z(s))  +  f(s,x(s),a[z](s),z(s))-D$(s,x(s)) 

♦  ♦t(s,x(s))  ]ds  i  ~ 

z€N(tg) .  Consequently 

,v 

sup  inf  f  {  h(s,x(s) ,a[z](s) ,z(s)) 
o€r(t0)  z€N(tQ)  [ 

+  f(s,x(s),oCz](s),z(s)),D^(s,x(s))  +  ♦t(s,x(s))ds)  »  . 


-22- 


initial  condition  x(tg)  =  xQ.  This  and  (4.5)  imply 

,v 

sup  inf  {  h(s,x(s),a[z](s),z(s))ds  +  <t>(tn+o,x(tn+o))-<{>(tn,xn)}  0. 

acr(tg)  Z€N(tg)  ' 

fc0 

Recalling  now  (4.8),  we  see  that  this  contradicts  (4.12),  and  thus 
(4.9)  must  hold. 

□ 

Lemma  4.3  Assume  $  is  C*. 

(a)  If  $  satisfies  (4.2),  then  for  all  sufficiently  small 

s 

o»Q  there  exists  z€N(tg)  such  that  (4.3)  holds  for  all  aer(tg). 

(b)  If  $  satisfies  (4.10),  then  for  all  sufficiently  small 
o>0  there  exists  aer(tQ)  such  that  (4.11)  holds  for  all  z€N(tg). 

Proof  Set 

A(t,x,y,z)  *  $t(t,x)  +  f(t,x,y,z) -ExMt.x)  +  h(t  ,x,y,z)  . 

(a)  According  to  (4.2.) 

min  max  A (tn ,xn ,y , z)  5  -0  <  0. 

z€Z  y*Y 

Hence  there  exists  some  z*€Z  such  that 

mav  A(t  ,xn,y,z*)  5  -0  • 

y€Y  0  u 


Since  A  is  uniformly  continuous,  we  have  also 


max  A(s,x(s) ,y,z*)  5 

y€Y 


provided  tgis5tg+o  (for  any  small  o>0)  and  x(*)  solves 


(ODE)  on  (tQ,t0+a)  for  any  y(*),  z(*),  with  the  initial 
condition  x(tQ)  =  xQ.  Hence  for  z(-)  s  z*  and  any  afTCtg) 

♦t(s,x(s))  +  f(s,x(s),a[z](s),z(s))*Dij>(s,x(s))  +  h(s,x(s)  ,a[z](s) ,z(s) )  ■£ 

for  tgSsitg+o.  Integrate  this  from  tn  to  tn+o  to  obtain 


(4.3). 


(b)  Inequality  (4.10)  reads 


min  max  A (tn ,xn  ,y  ,  z)  >  9  >  0. 

ziZ  y€Y  u 

Hence  for  each  z€Z  there  exists  y=y(z)€Y  such  that 


A(t0,x0,y,z)  >  9  . 

Since  A  is  uniformly  continuous  we  have  in  fact 

A(t0,y0,y,s)  >  -5- 

for  all  £€B(z,r)r,Z  and  some  r  =  r(z)>0.  Because  Z  is  compact 
there  exist  finitely  many  distinct  points  z ^ , .  .  . zn€ Z ,  y^ , . . . yn^Y ,  and 
rl’'"'rn>0  such  that 


Z  r  U  B(zi,ri) 
i  =  1 


A  ( t  g  »Xq  i  y  i  ■>  K ) 


for  y  €  B( ? ■ , r . ) 

’  i  ’  i 


Define 


i>:  Z  -  Y 
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by  setting 


5.  Representation  of  solutions  of  Hamilton-Jacobi  equations 

We  next  employ  the  theory  from  §2-4  to  derive  a  represent 
tation  formula  for  the  viscosity  solution  of 


(5.1) 


Here 


ut  +  H(t,x,Du) 


u(0,x)  =  g(x) 


g:  3R“  -  TR 


(x  f  ]Rm,  Ckt<T) 


and 


H:  [0  ,T]  x  ]Rm  x  ]Rm  -*■  ]R 


satisfy 


(5.2) 


and 


f 


I  g(x) |  <  C, 


^(x)  - 


g(£)i  s  C5|x-x| 


(5.3) 


| H( t ,x, 0 )  |  <  C5 


|  H(t  ,x,p)  -  H(  t ,  x ,  p)  |  «  C5(|t-t|  +  |  x— x  |  +  |p-p|) 


for  some  constant  C5  and  all  Ost,  tv'T,  x,  x,  p,  p(  TRm  . 

Then  results  of  Crandall-Lions  [8],  Lions  T  2 3  3  ,  and  Souganidis 
[27],  [28]  imply  the  existence  of  a  unique  viscosity  solution 
u  of  (5.1),  with 


(5.4) 


I  | u(t,x)|  S  C  6 

|u(t,x)  -  u(t,x)|  5  Cg (  I  t-t  I  +  I  X-X I  ) 


for  some  constant  Ce. 

b 

First  we  write  H  as  the  max-min  of  appropriate  affine 
functions : 


Lemma  5 . 1  For  each  OftsT,  x€!Rm  and  constant  TWO, 


(5.5)  H(t,x,p)  =  max  min  {  f(y)*p  +  h(t,x,y,z)} 

ziZ  y i'i 


if  | p |  <  A,  where 


(5.6) 


^  Y  =  B(0,1)  <- 

Z  =  B(0,A)  c  TRm 

*  f(y)  =  c&y 

h(t,x,y,z)  =  H(t,x,z)  -  Cj-y-z 


Proof  Since 


H(t,x,z)  -  H(t,x,p)  *-  Cr!p-x|  (z  e  TKm)  , 

we  have  for  | p  j  A 

H(t,x,p)  =  max  {  H(t ,x  ,z)  -  Crlp-zl) 
zfZ 


=  max  min  (  H(-:,x,z)  +  Cty-(p-z)}  . 
z€7.  y f Y 


n 


Remark  See  Fleming  [14,  p,  996-1000]  or  Evans  [12]  for 
other,  more  complicated  ways  of  writing  a  nonlinear  function 


as  the  max-min  (or  min-max)  of  affine  mappings. 

Note  that  f  and  h  satisfy  (2.1)  and  (2.3),  respectively. 
Now  set 

H(t,x,p)  =  max  min  {  f(y).p  +  h(t,x,y,z)}  (p  €  lRm) 
z(Z  y(Y 


for  A  =  Cg  from  (5.4),  Y,  Z,  f,  h  from  (5.6).  Then 


H(t,x,p)  =  H(t,x,p)  provided  |p|  <  C 

P 

As  u  satisfies  (5.4)  it  follows  from  the  theory  in  [8]  that 
u  is  also  the  unique  viscosity  solution  of 


ut  +  H(t,x,Du)  =  0 


u(x, 0)  =  g(x) 


(x  6  ]Rm,  0  <  t  <  T) 


Hence 


(5.7) 


v(t,x)  =  u(T-t,x) 


is  the  viscosity  solution  of 

^"vt  +  H+(t  ,x  ,Dv)  =  0 


(x  (  ]Rm,  0  <  t  <  T) 


v(x,T)  =  g(x) 
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for 


H  (t,x,p)  =  min  max  {  -f(y).p  -  h(T-t,x,y,z) } 

z(Z  y(Y 


Thus  the  developments  in  §2-4  imply 


v(t,x)  =  U(t,x) 


fT 

sup  inf  {-  h(T-s,x(s),a[z](s),z(s))ds  +  g(x(T))}  , 

a(IXt)  z€N(t)  •* 


where  x( • )  solves 


xCs)  =  -f(y(s))  =  -C5y(s) 

X  ( t )  =  X 

w 

for  y(*)  =  a[ z] ;  that  is, 

iS 


(t  <  s  <  T) 


x( 


s)  =  x  -  C5j  a[z](r)dr  (t  <  s  <  T) . 


Recall  now  (5.7)  to  complete  the  proof  of 


Theorem  5.2.  We  have  for  each  0<t<T  and  x  €  ]Rm  , 

r 

T-t 


(5.8)  u(t,x>  =  sup  inf  f  -[  h(T-s,x(s)  ,a[z](s)  ,z(s))ds  +  g(x(T))} 

a€f(T-t)  zCN(T-t)  J 


where  for  each  z(N(T-t)  and  y  =  c[z]  (  M(T-t),  x(*)  solves 

r 


(5.  3) 


x  ( s ) 


x(T-t) 


-C5y(s) 


T  -  t  <  s  <  T 
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Remark 


A  formula  analogous  to  (5.8)  obtains  for  any  choices 


of  Yt  Z|  f  and  h  for  which  (5.5)  holds  (even  if  f  =  f(t,x,y,z)). 
The  representation  we  have  taken  has  particularly  simple 
dynamics:  note  that  player  II  can  affect  only  the  running 
cost  h. 

o 

An  easy  application  is  the  following  domain  of  dependence 
assertion. 

Corollary  5.3  (cf.  [8]).  Assume  H  satisfies  (5.3)  and  that 

g,g  :  3Rm  1R 


satisfy  (5.2),  Suppose  also  that  u  is  the  viscosity  solution 
of  (5.1)  and  u  is  the  viscosity  solution  of 

r 


(5.1) ' 


ut  +  H(t,x,Du)  =  0 


u(0,x)  =  g(x) 


(x  €  3Rm,  0  <  t  <  T) 


Fix  x€B  ,  0<t<T.  Then  if 


g  ■  £  on  B(x,tC.) 


we  have 


u(x,t)  =  u(x,t) 


Proof  By  Theorem  5 . 2 


u(t  »x)  » 


rT 

sup  inf  (  -I 

atr(T-t)  z€N(T-t)  l  . 

T-t 


h(T-s,x(s).a[z](s)>z(s))ds  ♦  g(x(T))} 


30- 


1 


where  for  T,  N,  h,  etc.  as  above  and  for  each  z€N(T-t), 
y  *  a[z]  i  M(T-t),  x  solves  (5.9).  But  then 

| x(T)  -  x(  <  tC5 


and  so 

g(x(T) )  =  g(x(T) ) . 


Thus 


rT 

u(t,x)  a  sup  inf  {  -I  h(T-s,x(s),a[z](s),z(s))ds  +  g(x(T))} 
a€r(T-t)  z€N(T-t)  'T-t 


a  u(t,x),  by  Theorem  5.2  again. 

o 

For  an  application  in  §6,7  we  will  require  a  modification 
of  (5.5),  (5.6)  in  the  case  that  H(t,x,-)  is  positively 
homogeneous  of  degree  one: 

Lemma  5.4  Suppose  in  addition  to  (5.3)  that 

H(t,x,Xp)  =  \H(t,x,p)  (0  <  t  <  T,  x,  p  €  TRm,  X  >  0)- 

Then  there  exist  compact  sets  Yc]R2m,  zc]R2?n  and 

f :  [0 ,T]  *  IRm  *  Y  *  Z  -►  ]Rm 

satisfying  (2.1)  such  that 

H(t,x,p)  =  max  min  {  f (t,x,y ,z) *p) 
z€Z  y€Y 
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I 


for  all  0<t<T,  x,p€lR 


Proof  If  |nl  =  1,  then  according  to  Lemma  5.1 

=  max  min  {  f(yj_) ‘V  +  h(t,x,v1 > 
zl€Zl  yieYl 


Y1  =  Z1  =  B(  0 , 1 )  c  TR 


f(yi)  =  csyi 

Mt^y-pZ-^)  =  H(t,x,z1>  - 


Thus  for  any  p^O 


H(t,x,p)  =  |p|  H(t,x,-y^|-) 


max  min  (f(y^)-p  +  h( t  ,x  ,y^  ,  )  |p|  }  , 

zl€Zl  yl*Yl 


Choose  C?>0  such  that 


for  all  0<t<T,  x<3Rm,  z-^Zp  V^Yp  Then 

H(t,x,p)  =  max  min  {f(y,)*p  +  C _,j p |  +  (h(t,x,ypZ^)  -  C 7>  | p i } 
zl€Zl  yl€Yl 

=  max  min  max  min  ■  f  (v-j  )*p  +  C.,z.7*p  +  (h(t,x,Vj  )-C^  )y7*p} 

*l‘Zl  yl€Yl  VZl  VY! 

=  max  min  f  f(t,x,y,/.)  *p} 

~.(7.  yfi 
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'**  7  «j»*  ~ 


w-  -  V 


where 


/*  .  _  2m 

y  =  Z  =  B(0,1)  x  B ( 0 , 1 )  c  ® 

z  =  (z1,z2),  y  =  <y1>y2) 

<  f (t,x,y,z)  =  f(yi>  +  C7z2  +  (h(t,x,yi,2i)  -  C?)y2 

=  c5yl  +  C7Z2 
v 

Note  that  the  interchanging  of 
valid. 


(H(t,x,z1)  -  Cgy-j^  •z1 


-  c„) 


min  and  max  above  is 
yl€Yl 


z2€Z1 
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6. 


Propagation  of  disturbances  and  Huygen' s  principle 


As  an  application  of  the  representation  formulas  developed 
in  §5  we  will  discuss  in  the  next  section  the  level  sets  of 
solutions  of  Hamilton-Jacobi  equations  with  Hamiltonians 
positively  homogeneous  of  degree  one.  The  following  considera¬ 
tions-  adapted  directly  from  Gelfand-Fomin  [17,  p.  208-217] 
and  Arnold  [1,  p.  248-258]  -  provide  motivation. 

Regard  IRm  as  a  heterogeneous,  nonisotropic  medium, 
comprised  of  points  at  each  moment  in  either  an  "excited"  or 
a  "rest"  state.  Once  any  given  point  x  is  excited  by  a  dis¬ 
turbance  propagating  in  the  medium,  it  thereafter  remains  ex¬ 
cited  and  so  itself  serve  as  a  source  for  further  disturbances 
emanating  from  it.  We  wish  to  describe  mathematically  the 
evolution  of  the  disturbances  from  a  given  excited  set. 

For  this  let  L(x,z)  denote  the  reciprocal  of  the 
speed  of  the  disturbance  leaving  x  in  the  direction  z€Sm  ^ . 
Extend  L  to  be  positively  homogeneous  of  degree  one  and  set 

I ( x )  s  {  z  €  TRm  |  L(x,z)  =  1}  ; 

I(x)  is  the  indicatrix  of  L  at  x.  We  will  assume  this  to 
be  the  smooth  boundary  of  an  open,  strictly  convex  set.  We 
consider  also  the  figuratrix 

F(x)  s  {p  =  D  L(x , z)  |  z  f  I(x)}  . 

z • 
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Next  define  the  Hamiltonian  H  so  that 


J  H(x,p)  =1  if  p  €  F(x) 

I  H(x,-)  is  positively  homogeneous  of  degree  one. 

This  is  the  standard  Hamiltonian  for  the  parametric  Lagrangian 
L  (see  Young  [30,  p.  50-51]),  and  the  reader  should  check 

that 

(6.1)  H(x,p)  =  sup{«*p|z  €  I(x)>  . 

Next  suppose  Tq  denotes  the  set  of  points  excited 
initially  and  rt  2  rg  the  set  of  points  excited  at  time 
t>0.  We  introduce  a  function  u:  TR  x  1R  -*•  TR  such  that 

(6.2)  rt  =  {x|u(t,x)  >  0} 

and 

(6.3)  lt  =  {  x j  u ( t , x )  =  0}  =  art 

for  each  t?0;  here  is  the  v/ave  front  at  time  t.  We 

will  show  heuristically  that  u  solves  a  Hami ] ton-Jacobi 
equation. 

To  see  this,  fix  any  t>0,  x€^t,  and  0«At<t.  According 
to  Huygen ' s  principle  is  the  envelope  of  the  wavefronts 

emanating  from  points  in  Iffit:  see  P*  250],  Thus  there 
exists  yfj  such  that  y+AtI(y)  is  -  up  to  error  terms 

of  order  O(at)  -  tangent  to  J  at  x.  So  for  some 
zil(y) , 
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y  +  (A t ) z  is  (approximately)  equal  to  x 


and 

p  s  -Du(t,x)  is  (approximately)  normal  to  y  +  Atl(y)  at  x  . 
Consequently 

(6.4)  H(x,p)  =  p«z  +  o(l)  as  At-*-  0 

On  the  other  hand 

o(At)  =  u(t-At,  x-(At)z)  -  u(t,x) 

=  (-At)(u^(t,x)  +  Du(t,x)-z)  +  o(At') 


and  so 

ut(t,x)  =  p-z  +  o(l)  as  At  -*■  0 
This  and  (6.4)  give 
(6.5)  ut  +  H ( x , Du )  =  0 

for 

H(x,p)  3  -H(x,-p)  . 

Note  that  the  reasoning  here  works  just  as  well  on  the  sett; 

{  u=a }  tor  each  real  number  o.  rhus  (6.5)  holds  in  all  of 

®n  *(0,T). 

In  (6.5)  we  have  derived  the  required  Hamilton-dueobi 
equation  for  u;  therefore,  in  principle,  to  find  the  excited 
sets  we  need  only  find  some  function  p:  v  IK  such  that 


a* 
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t 


(6.6) 


{ x | g(x)  >  0} 


and  then  solve  (6.5)  subject  to  the  initial  condition 

(6.7)  u(x,0)  =  g(x)  (x  €  ]Rm). 

The  sets  r  are  then  given  by  (6.2). 

However,  in  addition  to  the  obvious  objection  that  (6.5), 
(6.7)  will  in  general  have  no  smooth  solution  for  large  time, 
it  is  not  immediately  clear  that  our  calculation  of 
Tt  =  {x|u(t,x)  >0}  is  independent  of  the  choice  of  g.  As 
we  will  see  in  §7  below  a  formal  calculation  using 
characteristics  indicates  that  T  does  indeed  only  depend 
upon  g's  satisfying  (6.6)  and  not  on  the  particular  choice  of 
this  function.  Nevertheless  a  rigorous  proof  cannot  use 
characteristics  (which  need  not  exist  in  the  large)  and  will 
instead  rely  upon  our  game  theoretic  representation  formulas 
for  the  viscosity  solution  of  (6.5),  (6.7). 

Remark  For  the  case  at  hand  H(x,0  is  convex  and  so  con¬ 
trol  theory,  rather  than  game  theory,  techniques  will  work. 

A  point  of  the  next  section  is  therefore  that  the  homogeneity 
and  not  the  convexity  of  H(x,*)  is  the  crucial  property. 

The  reader  should  also  note  in  the  above  context  that  Huvgen's 
principle  is  a  version  of  the  optimality  principle  in  dynamic 
programming . 


a 


7.  Level  sets 


Motivated  by  considerations  in  56  we  now  prove 

Theorem  7.1.  Let  H:  lRmx]Rm-*lR  bv  .  ' formly  Lipsehitz  and 
positively  homogeneous  of  degree  1  in  its  second  argument. 
Assume  g,  g  are  bounded, uniformly  Lipsehitz  and  are  positive 
on  the  same  set;  that  is, 


(7.1)  {x  €  )Rm  |  g  ( x )  >0}  =  {x  €  lRm|£(x)  >  0). 


m  ,  t 


Suppose  u,  u  are  the  viscosity  solutions  of,  respectively. 


u^+  H(x,Du)  =  0 


(t  >  0,  x  €  lRm) 


(7.2) 


and 


u(0,x)  =  g(x) 


(7.3) 


^ut  +  H(x,Du)  =  H 


u(0,x)  =  g(x) 


(t  >  0,  x  £  1Km) 


Then  for  each  T>0 


(7.4)  [x  6  lRm  |  u  ( T ,  x )  >0}  =  {  x  6  Fm|u(T,x)  *»  0)  . 

Note  that  we  do  not  require  H  to  be  convex  in  p,  and 
that  "0"  in  (7.1),  (7.4)  can  be  replaced  by  any  real  number. 
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Formal  proof 


For  heuristic  purposes  we  begin  with  a  formal  proof  of 
(7.4).  under  the  additional  assumptions 

(H  i  for  p  i  0,  u,  u  €  C2  , 

2q  *  a{  g  >  0}  *  a{  g  >  0}  is  a  smooth  manifold  , 

Dg,  Dg  i  0  on  20  . 


Consider  first  (7.2)»and  for  each  Xg€3Rm  define  the  character 
istics  x,p:  CO,**)  ■*  IR®  as  follows: 


*<t) 

a  DpH(x(t) *p(t) )  , 

x(0) 

II 

X 

o 

#><t) 

a  -DxH(x(t) ,p(t))  , 

p(0) 

=  po 

2 

for  Pq  •  Dg(xg).  Since  u  is  C  ,  we  have 

p(t)  =  Du(t,x(t>>  (t  >  0) 

and 

u(t,x(t))  a  g(xQ)  ♦  |lH(x(s),p(s))  -  p(s)  .DpH(x(s)  ,p(s))]ds  . 

0 


But 

(7.7)  H  ■  P*DpH 


since  H  is  homogeneous  of  degree  one;  consequently 


<7. 8) 


U(t,X(t))  ■  g(Xg)  . 


(t  >  0) 


In  particular 


(7.9) 


u(t,x(t))  «  0  if  Xq  €  ZQ  . 


We  next  claim  that 


(7.10)  x(*)  depends  only  on  xn  and  * 


P Q  _  n*(*0> 

I Pn I  I Dff Cxn> | 


To  see  this  set 


and  compute 


■  tItw  (t  ’ 


*  *  Tfr-^H2 


-DvH(x,p)  ( p • D  H ( x , p ) ) p 

(Pi  I  Pi  3 


■D  H(x^  ♦  (n *d  H(x,n))n  ,  (t  >  o) 

X 


since  H  and  therefore  D^H  are  homogeneous  of  degree  one. 
On  the  other  hand  DpH  is  homogeneous  of  degree  zero  and  so 

i.  -  DpH(x,p)  =  DpH(x,n)  . 


Thus 


(7.11) 


*  =  DpH(x,^)$  x(0)  *  xQ 


t)  *  -dvh(x,ti)  ♦  (Ti*DvH(x,-n))n»  n<0)  s  ; 


characteristics 


this  proves  (7.10). 

Finally  let  x,p:  C  0 ,  —  3  -*  lRm  be  the 
for  u: 


(7.12) 


x  =  D  H (x , p ) ,  x(0)  -  x. 


p  =  -DxH(x,p),  p ( 0 )  =  P0  , 


where 


P0  =  Dg(x0)  . 


As  above  x(-)  depends  only  on  rj  = 


Hence  if  x0€ZQ,  ;  and  thus 


P0  DgCx0) 


|P0I 


x(t)  =  x(t) 


(t  >  0) 


Since  therefore  u(t,x(t))  =  0  and  since  both  u  and  u 
are  constant  along  characteristics,  we  have 

(x  €lRn|u(t,x)  =  0}  =  { x  5  ]Rn  I  u(t  ,x)  =  0}  (t  -  0). 


This  completes  the  formal  proof  of  (7.4)  . 

a 


A  rigorous  proof  along  the  lines  above  seems  unlikelv, 

,  A  1 

as  the  solutions  u,  u  are  generally  not  even  C  ,  the 
characteristics  may  cross,  p  or  p  may  equal  zero,  etc. 
Instead  we  use  the  game  theoretic  representation  of  the 
solution  afforded  by  Theorem  5.1.  Here  we  regard  the 
(approximate)  optimal  trajectories  as  being  (approximate) 


generalized  characteristics. 


Proof  of  Theorem  7 . 1 

According  to  Lemma  5.4 


H(x,p)  =  max  min  {f(x,y,z)*p} 
z€Z  y*Y 


(p,  x  *  lRm) 


for  appropriate  compact  sets  Y,  Z,  and  f  satisfying  (2.1) 
Thus  u  is  the  viscosity  solution  of 


(7.13) 


u.  +  max  min  {  f(x,y,z)*Du)  =  0 

z€ Z  yeY 


u(x,0)  =  g(x) 


Fix  any  T>0  and  set 


U(t,x)  s  u(T-t ,x)  (0  <  t  5  T,  x  f  lRm)  ; 


then  U  is  the  viscosity  solution  of 


+  min  max  {  -f (x ,y , z) • PU } 
z€Z  y€Y 


U(T,x)  =  g(x) 


Thus,  by  the  uniqueness  of  viscosity  solutions. 


U(t,x)  =  sup  inf  {  g(x(T))}  , 
a€T(t)  zfN(t) 


where 
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V, 


(7.14) 


-f(x(s),a[z](s),z(s))  (t  --  s  - 


X  . 


Similarly  define 


U(t,x)  =  u(T-t,x) 


(0  5  t  *5  T,  X  €  1R11 


so  that 


U(t,x)  =  sup  inf  {  g(x(T) ) }  , 
a€ T ( t )  z€N(t) 


x( • )  solving  (7.14). 

Next  assume 

(7.15)  u(T,x0)  >  0; 

then 

U( 0 ,xn)  =  sup  inf  {  g(x(T))}  > 

u  o€T(0)  z€N(0) 


Fix 


0  <  2 e  <  U( 0 ,Xq) 


and  then  choose  a€F(0)  such  that 

(7.16)  inf  {  g(x(T) ) }  >  f. , 

z€N ( 0  ) 


x( • )  solving 


s  -f (x(s) ,a[z](s) ,z(s) )  ( 0  <  s  <  T) 

*  xo  * 

z€N(0) , 

x(T)  €  {  g  >  e}  £  {  g  >  0  } 

o(e)  >  0.  Consequently 

inf  {  g(x(T) ) >  >  a, 

z€N(0) 

xC*)  solving  (7.17).  Therefore 

u(T,xn)  =  U(0,xn)  =  sup  inf  { g(x(T) ) }  >  0. 

u  u  a<r(0)  z(N(0) 

We  have  proved  u(T,xQ)  >  0  implies  u(T,xQ)  >  0,  and  the 
opposite  implication  follows  from  interchanging  u  and 
in  the  argument  above.  This  proves  (7.4). 


Thus  for  any 


for  some  o  = 
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